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SIGNAL STATISTICS DETERMINATION 



FIELD OF THE INVENTION 

This invention relates to a method and apparatus for determining 
5 statistical characteristics of a signal, and is particularly but not exclusively 
applicable to characterisation of continuous-time random or chaotic or 
irregularly-behaved signals. 

BACKGROUND OF THE INVENTION 

10 There are many circumstances in which the statistical characteristics 

of a signal need to be analysed, for the purpose of, for example, classification 
of the signal, or monitoring or prediction of the signal behaviour. As will be 
described in further detail below, an example in which such determination is 
useful is that of random number generation, for example for use in 

15 cryptography. A random or chaotic noise signal can be applied to a digitiser 
which samples the signal at predetermined sampling intervals and outputs a 
digital representation of the signal which constitutes a random number. For 
efficiency, the sampling interval should be short. However, short sampling 
intervals may lead to random numbers which are not statistically independent 

20 of each other. It would therefore be desirable to analyse the statistical 
characteristics of the noise signal so as to enable the determination of the 
minimum sampling interval which is required to produce statistically 
independent random numbers. 
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There are many other circumstances in which signal statistics 
determination is useful. Where the signal represents variations in a physical 
parameter of a source, the statistical analysis can be used to classify the 
source. For example, each signal may represent variations within an image, 
5 and the statistical assessment can be used to classify the subject of the image. 
Similarly, statistical analysis could be used for classification of sound, such as 
speech or music. 

Known analysis techniques include frequency-domain (or spectral) 
methods, and time-domain methods. Time-domain methods are often 

10 necessary in order to provide the required information, and are commonly 
based on autocorrelation of the signal. 

Conventional correlation techniques are however based on the implicit 
assumption that the signal of interest is Gaussian, and that the statistical 
behaviour of the signal when considered in the forward direction of time 

15 corresponds to that in the backwards direction of time; any asymmetry in the 
behaviour is lost due to the fact that a correlation function is insensitive to the 
time direction. In practice, many of the signals being monitored are actually 
non-Gaussian. Non-linear dependencies in such signals may not be detected 
by standard correlation techniques. 

20 It would therefore be desirable to provide a method and an apparatus 

for analysing the statistical behaviour of a signal, which provides a more 
useful result than the prior art techniques. 
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DESCRIPTION OF THE INVENTION 

Aspects of the present invention are set out in the accompanying 

claims. 

5 In accordance with a further aspect, a signal is examined to detect a 

plurality of events, each event corresponding to the signal adopting a 
predetermined slope when crossing a threshold level. (In a preferred 
embodiment, the signal is deemed to have a predetermined slope if the slope 
is, for example, positive as distinct from negative. Thus, each event occurs 

10 when the signal crosses the threshold as its level rises (i.e. at each 
"upcrossing") or when the signal crosses the threshold as its level is 
decreasing (i.e. each "downcrossing").) 

Multiple versions (preferably identical copies) of the signal are 
derived from that single signal, and are shifted relative to each other such that 

15 each version contains an event which coincides with respective different 
events in the other versions. The multiple versions are then combined, for 
example by averaging (where the term "averaging" is intended herein to 
encompass summing). 

The resulting function is a measure of the signal's average behaviour 

20 prior to and following the detected events. For convenience, this function will 
be referred to herein as the "crosslation function" and a device which is 
arranged to derive such a function will be referred to as a "crosslator". The 
function will be referred to as a "forward crosslation" function if the events 
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upon which it is based are upcrossings, and a "backward crosslation" function 
if the events upon which it is based are downcrossings. 

The shape of the crosslation function of a signal, which will be 
dependent upon the threshold level and the type of event upon which the 
5 crosslation function is based, will contain useful information regarding the 
input signal. At a given point relative to the origin (defined as the point at 
which the respective events are combined), the amplitude of the function will 
represent the bias of the input signal towards a particular value at a 
corresponding time relative to each event. 

10 Furthermore, the relationship between the shapes of different 

crosslations (especially forward and backward crosslations) contains further 
useful information. It will be understood that downcrossings are, when the 
signal is reversed in time, equivalent to upcrossings. Therefore, a time 
reversible signal will exhibit symmetrical forward and backward crosslation 

15 functions for any given threshold level. Accordingly, the relationship 
between these functions will be an indicator as to the time reversibility of the 
input signal. 

Furthermore, changes in the shape of one or more crosslation 
functions may also contain useful information regarding the nature of the 
20 input signal. 

Accordingly, a device of the present invention preferably extracts one 
or more parameters dependent upon the shape of one or more crosslation 
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functions to provide a value or series of values representative of statistical 
properties of the input signal. 

For example, in an embodiment described below, the forward and 
backward crosslation functions are investigated to determine their amplitudes 
5 at points which correspond to the intervals between sampling pulses which are 
used to sample a random input signal for the purpose of random number 
generation. If the amplitudes depart significantly from the average value of 
the input signal, this suggests that sampling at this interval would result in a 
bias in successive sample values which would reduce their independence. 
10 Accordingly, the output of the analysis device can be used to indicate or 
correct this undesirable situation. 



DESCRIPTION OF THE DRAWINGS 

Arrangements embodying the present invention will now be described 
15 by way of example with reference to the accompanying drawings, in which: 

Fig. 1 depicts a random number generator incorporating a signal analysis 
device according to the present invention; 

Figs. 2a) and 2b) show a chaotic signal x(t) used by the generator of Fig. 

i; 

20 Fig. 3 depicts a segment of the chaotic signal x(t) and a plurality of 

trajectories associated with all upcrossings of a level observed within the signal 
segment; 

Fig. 4 depicts the trajectories of Fig. 3 when superimposed; 



6 

Fig. 5 shows an empirical forward crosslation function C + L (x) of the 
chaotic signal x(t) obtained by averaging the trajectories in Fig. 4; 

Fig. 6 depicts an empirical backward crosslation function C"l(t) of the 
chaotic signal x(t); 

5 Fig. 7 is a block diagram of a monitoring unit of the generator of Fig. 1, 

the unit incorporating the signal analysis device; 

Fig. 8 depicts the shapes of the empirical forward crosslation function 
C + l(x) obtained experimentally for three different crossing levels L: (a) L = 3a; 
(b) L = 2a; (c) L = a, where a is the rms value of the signal under 
10 investigation; 

Fig. 9 is a flowchart of the operation of a time-shift comparator of the 
unit of Fig. 7; 

Fig. 10 depicts the shapes of a crosslation sum function Sl(x) and a 
crosslation difference function E>l("0; 
1 5 Fig. 1 1 is a block diagram of a modified version of the signal analysis 

device of Fig. 7; and 

Fig. 12 shows a different modified version of the signal analysis device; 

and 

20 DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

Referring to Figure 1 , this shows a random number generator which uses 
a signal analysis device in accordance with the present invention. 
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The random number generator comprises a physical random signal 
source (PRS) which generates a chaotic output signal x(t). A typical waveform 
of the signal x(t) is shown in each of Figs. 2a) and 2b). 

The signal x(t) is delivered to an analog-to-digital converter (ADC), 
5 which also receives sampling pulses from a sampling pulse generator (SPG). 
The chaotic signal x(t) is sampled by a sampler (SMP) at intervals 
corresponding to the period between sampling pulses, and each analog output is 
applied to an amplitude quantiser (QUA). The quantiser generates J different 
quantisation levels, against which the analog input sample is compared. At the 
10 output (OP) a digital number is produced in dependence upon the level of the 
analog sample. 

Accordingly, the random number generator generates, at intervals 
corresponding to the period between sampling pulses, random numbers 
distributed within the range 0 to J. 

15 The system described so far is known. In the embodiment of Fig. 1, a 

monitoring device (MON) is provided. This receives the chaotic signal x(t) and 
the quantisation levels 1 to J from the quantiser (QUA) and generates a monitor 
output (MOP) which indicates whether or not the random numbers can be 
expected to be statistically independent, as will be explained in further detail 

20 below. 

The monitoring device (MON) is shown in Fig. 7, and comprises a 
signal analysis device (also referred to herein as a crosslator) (CRS) in 
accordance with the present invention. This receives the signal x(t) and also 
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successively receives each of the quantisation level signals 1 to J via a parallel to 
serial converter (PTS). The crosslator (CRS) outputs a crosslation function (as 
explained below) at an output (CFO) to a time shift comparator (TSC). The 
time shift comparator (TSC) derives a signal MSI, which represents the 
minimum sampling interval required to obtain statistically independent samples. 
A comparator (CMP) compares this value with a value SPI representing the 
current sampling pulse interval. The comparator generates the monitor output 
(MOP), which indicates whether or not the current sampling pulse interval 
exceeds the calculated minimum sampling interval, as it should for correct 
operation. 

The principal of operation of the crosslator (CRS) will be described with 
reference to Figs. 2 to 6. 

Referring to Fig. 2a), this shows the signal x(t), which represents a 
random, chaotic or other irregular process continuous in time, and a constant 
level (threshold) of value L. There are time instants at which the signal x(t) 
crosses the level L with a positive slope. The resulting time instants 

t i, t 2, , t |c-i, t |c t k+l» — 

form a set of upcrossings of level L; those upcrossings are marked with dots in 
Fig. 2a). 

Select any one of those upcrossings, say that at t\ 9 and consider the 
signal x(t) before and after the time instant t\. A signal trajectory x + k (x) 
associated with the upcrossing at t + k is defined by 

X + k (T) = x(t + k +T) 
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where x is the relative time. Therefore, the selected trajectory x\(x), shown in 
Fig. 3, is simply a time-shifted copy of the signal x(t) under examination. 
Irrespective of the time origin, t = 0, of the underlying signal x(t), the trajectory 
x + k(T), being a function of the relative time x, will always contain the origin x 
5 =0. 

In accordance with the above construction, each upcrossing of level L 
defines a corresponding time-shifted copy of the underlying signal x(t). Fig. 3 
depicts, separately and sequentially, trajectories which are generated by all 
upcrossings of level L in the illustrated signal segment x(t). All upcrossings 
10 coincide, in that they jointly define and share the same origin x = 0 of the 
relative time x . 

The trajectories of Fig. 3 are also shown superimposed in Fig. 4 as 
functions of the relative time x . 

The trajectories {x + i(x), i = 1, 2, ... , k-1, k, k+1, ... }, associated 

15 with the corresponding upcrossings at {t*, i = 1, 2, ... , k-1, k, k+1, ... }, can 
be averaged to derive a function C + L (x), referred to herein as the forward 
crosslation (FC) function. For illustrative purposes, Fig. 5 depicts an empirical 
forward crosslation function C\(x) obtained by averaging the trajectories 
shown in Fig. 4. The function characterises the average behaviour of signal x(t) 

20 conditioned on upcrossings of level L, and will depend on the relative time x. In 
particular, the value at x = 0 is, by construction, simply equal to L, as can be 
deduced from Fig. 4. For large values of x, C + L (x) tends to the mean AV of the 
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underlying primary process x(t), because the dependence on the upcrossing 
vanishes. 

In a similar manner, the time instants are determined at which the signal 
x(t) crosses the level L with a negative slope. The resulting time instants 

t l> t 2> •■- 9 t m- 1> t m , t m+], — 

shown in Fig. 2b), form a set of downcrossings of level L. 

By a process analagous to that described with reference to Figs. 3 to 5, it 
is possible to derive a function C"l(t), shown in Fig. 6, which corresponds to 
the forward crosslation function C + L (i) except that it is based on downcrossings, 
rather than upcrossings. The function therefore represents the average behaviour 
of x(t) conditioned on downcrossing of level L. 

It should be noted that the downcrossings of level L by a signal x(t) 
coincide with the upcrossings of level L by a time-reversed replica x(-t) of the 
underlying signal x(t). Therefore, the crosslation function C"l(i) based on 
downcrossings will be referred to as the backward crosslation (BC) function. 
Also in this case, C"l(0) = L, and C\( |x| ) approaches the mean value AV for 
large values of t . 

When the forward and backward crosslation fiinctions are determined for 
unipolar signals assuming only positive values, the threshold level L is always 
positive. However, in the case of bipolar signals, several approaches are 
possible: 

1 . only non-negative (or non-positive) threshold levels are used; 
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2. positive and negative (including zero) threshold levels can be 
used for signal processing; 

3. only non-negative (or non-positive) threshold levels are used, but 
both the original signal and its reversed-polarity replica are processed. 

5 The forward crosslation (FC) function and the backward crosslation 

(BC) function provide a useful characterization of the process under 
investigation. For example, for positive values of the relative time x , the forward 
crosslation (FC) function facilitates the prediction of future values of a process 
given that the process has crossed at some time instant a predetermined level 
10 with a positive slope. For negative values of i, the forward crosslation (FC) 
function describes the average behaviour of the process prior to the upcrossing 
time instant. 

In a similar manner, the backward crosslation (BC) function facilitates 
the prediction of future values of a process given that the process has crossed a 

15 predetermined level with a negative slope. For negative values of the relative 
time t, the backward crosslation (BC) function describes the average behaviour 
of the process prior to the downcrossing time instant. 

When a process is examined in reversed time, the roles of the forward 
crosslation (FC) function and the backward crosslation (BC) function are 

20 interchanged. Consequently, for time-reversible processes, the forward 
crosslation (FC) function and the backward crosslation (BC) function are mirror 
images of one another. Thus, the forward crosslation (FC) and backward 
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crosslation (BC) Amotions can be exploited for testing time reversibility of 
processes of interest. 

According to an embodiment of the present invention, the forward 
crosslation (FC) function and/or the backward crosslation (BC) function can be 
5 derived using the crosslator (CRS) shown in Fig. 7. It is to be noted that the 
crosslator (CRS) forming part of the monitor (MON) of Fig. 7, and the modified 
crosslators to be described below, may be formed as general-puipose devices, 
possibly constructed on a separate integrated circuit, for use in a variety of 
different applications. Some of the functionality provided by the crosslators 

10 may not be required in certain applications, and indeed not all the functions to be 
described below are necessary for use in the monitor (MON) of Fig. 7. 

The crosslator (CRS) comprises a polarity-reversal circuit (PRC), an 
analogue delay line (TDL) with multiple taps, a level crossing detector (LCD), 
two pulse delay circuits (PDL and DEL), a pulse counter (PCT), a plurality of 

15 sample-and-hold circuits (SHC), a plurality of accumulators (ACC) and a 
storage register (SRG). The storage register (SRG) may also incorporate a 
suitable waveform interpolator. 

The polarity (positive or negative) of a time-varying input signal x(t) is 
set by an appropriate value held at a binary polarity-select input (PS) of the 

20 polarity-reverse circuit (PRC). The signal with selected polarity is then applied 
to an input (IP) of the delay line (TDL). In the shown configuration, each of M 
taps of the delay line (TDL) provides a time-delayed replica of the signal 
appearing at the input (IP). At any time instant, the signal samples observed at 
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the M taps of the delay line (TDL) form jointly a discrete-time representation of 
a finite segment of the signal propagating along the delay line (TDL). 
Preferably, the relative delay between consecutive taps of the delay line (TDL) 
has a constant value. 

Each of the M taps of the delay line (TDL) is connected to a respective 
sample-and-hold circuit (SHC), and a selected tap (CT), preferably the centre 
tap, is also connected to the level crossing detector (LCD). 

The level crossing detector (LCD) detects either upcrossings or 
downcrossings, depending on the value held at a binary selector input (UD). The 
desired crossing level L is set by applying a suitable threshold value to a 
threshold input (LV) of the level crossing detector (LCD). When the forward 
crosslation (FC) function is to be determined, the level crossing detector (LCD) 
operates as a detector of upcrossings. Similarly, when the backward crosslation 
(BC) function is to be determined, the level crossing detector (LCD) detects 
downcrossings. 

When the forward crosslation (FC) function is being determined, each 
time an upcrossing of a prescribed level L is detected at centre tap (CT) by the 
level crossing detector (LCD), a short trigger pulse (TP) is generated at the level 
crossing detector (LCD) output. The trigger pulse (TP) initiates, via a common 
trigger pulse (TP) input, the simultaneous operation of all sample-and-hold 
circuits (SHC). Each sample-and-hold circuit (SHC) captures the instantaneous 
value of the signal appearing at its input and supplies this value to a respective 
accumulator (ACC). 
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The trigger pulse (TP) also increments by one the current state of the 
pulse counter (PCT). The capacity of the pulse counter (PCT) is equal to a 
predetermined number N of level crossings (i.e. the number N of signal 
trajectories being processed). The trigger pulse (TP) is also applied to a suitable 
5 pulse delay circuit (PDL) whose delay is preferably equal to the settling time of 
the sample-and-hold circuits (SHC). 

A delayed trigger pulse obtained from the pulse delay circuit PDL 
initiates, via a common accumulator input (DT), the simultaneous operation of 
all accumulators (ACC) driven by respective sample-and-hold circuits (SHC). 
10 The function of each accumulator (ACC) is to perform addition or averaging of 
all N samples appearing successively at its input during one full operation cycle 
of the crosslator (CRS). 

When a predetermined number N of level crossings has been detected by 
the level crossing detector (LCD), and registered by the pulse counter (PCT), an 
15 end-of-cycle (EC) pulse is produced at the output of the pulse counter (PCT). 
The end-of-cycle (EC) pulse resets the pulse counter (PCT), via a reset input 
(RT) thereof, and it also initiates the transfer of the accumulators 1 contents to the 
storage register (SRG). Each end-of-cycle (EC) pulse, suitably delayed by the 
pulse delay circuit (DEL), sets all the accumulators (ACC) to their initial zero 
20 state via a common input reset (RS). Shortly after the occurrence of the end-of- 
cycle (EC) pulse, a discrete-time version of the determined forward crosslation 
(FC) function is available at the output (CFO) of the storage register (SRG). 
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When no waveform interpolation is used in the storage register (SRG), 
the determined forward crosslation (FC) function is represented by M values. 
However, some additional signal processing may be performed in the storage 
register (SRG) to produce an interpolated (smoothed) representation of the 
5 forward crosslation (FC) function comprising more than M primary values 
supplied by the accumulators (ACQ. 

Fig. 8 shows the shapes of the empirical forward crosslation (FC) 
function determined experimentally for three different values of upcrossing level 
L: L — a, L = 2 a and L = 3a, where a is the rms value of the processed signal. 
10 In this case, the signal x(t) processed by the crosslator was generated by a 
physical noise source. 

When the backward crosslation (BC) function is being determined, each 
time a downcrossing of level L is detected at tap (CT) by the level crossing 
detector (LCD), a short trigger pulse (TP) is generated at the level crossing 
1 5 detector (LCD) output. The remaining functions and operations are identical to 
those performed by the crosslator in the case of determining the forward 
crosslation (FC) function. 

When fast-varying signals are to be processed, the delay introduced by 
the level crossing detector (LCD) may be excessive and should be compensated. 
20 The delay compensation can for example be accomplished by employing one of 
the following two approaches: 

1. The level crossing detector (LCD) is driven by a tap preceding centre 
the tap (CT), and such obtained pre-trigger pulse is additionally delayed at the 
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level crossing detector (LCD) output by an auxiliary circuit, so that the total 
delay introduced (by the level crossing detector (LCD) and the circuit) matches 
the relative delay between the two taps. 

2. A dedicated pre-trigger tap is provided by the delay time (TDL), the 
5 pre-trigger tap preceding the centre tap (CT), and the relative delay between the 
two taps matching that of the level crossing detector (LCD). 

The operation has been described above in the assumption that the input 
signal x(t) is unipolar. However, the crosslator (CSR) is also operable to handle 
bipolar signals and to derive respective functions based on both positive and 

10 negative threshold crossings. In order to achieve this, whenever a function 
based on a negative threshold is being derived, the polarity-reverse circuit (PRC) 
is caused by the signal at polarity-select input (PS) to reverse the polarity of the 
input signal x(t) so that the level crossing detector (LCD) can use a 
corresponding positive crossing level for deriving the required function. 

1 5 The operation of the monitor (MON) of Fig. 7 will now be described. 

Initially, the parallel to serial converter (PTS) is arranged to transfer the 
value of quantisation level 1 to the threshold input (LV) of the level crossing 
detector (LCD). The signal input (UD) of the level crossing detector is set such 
that the crosslator produces at its output (CFO) the forward crosslation function. 

20 Referring to Fig. 5, it is assumed that the crosslation function has a 

significant value if the modulus of the difference between its value and the 
average value AV of the input function x(t) is greater than a threshold TH. 
Accordingly, the value is significant within the range - x a to + Tb- 
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If the sampling interval is less than | Xb I , then there is a danger than 
successive random values will have a bias depending upon their preceding 
values, because significant forward crosslation function levels for positive 
values of x represent the forward predictability of the function. 
5 Correspondingly, if the sampling level is less than | x a | , then preceding random 
numbers have a bias associated with their succeeding values, i.e. there is a risk 
of backwards predictability, i.e. that a preceding value can be determined from 
later values. In random number generation it may be important to avoid this so 
as to prevent prediction of a random number "seed value". 

10 Accordingly, it would be desirable to ensure that the minimum sampling 

interval is greater than the largest of | x a I and | x b I . The time-shift comparator 
(TSC) examines the crosslation function to determine the maximum value of 
I x | at which there is a significant difference between the crosslation function 
and the average value AV of the input signal x(t). 

15 The input (UD) is then switched so that the crosslator produces the 

backward crosslation function at its output, and the time-shift comparator again 
operates to find the maximum value |x| where the crosslator output is 
significant. 

Then, the parallel to serial converter (PTS) is operated to transfer the 
20 second quantisation level to the level crossing detector (LCD) and the crosslator 
operations are repeated so as to obtain the forward and backward crosslation 
functions. This sequence is carried out for each of the quantisation levels 1 to J. 
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Accordingly, the time-shift comparator (TSC) calculates multiple values, 
Tjj, for both the forward and backward crosslation functions for all the 
quantisation levels 1 to J, wherein i = 0 (for forward crosslation) or 1 (for 
backward crosslation) and j = 1 to J, each value xy representing the maximum 
value | t | at which the respective crosslator function is significally different 
from the average value AV. 

The minimum sample interval MSI is then calculated as: 

MIS = the maximum value of xy, for i = 0, 1 and j = 1 to J. 

This operation is shown in more detail in the flowchart of Fig. 9. The 
first quantisation level (j = 1) is selected at step 900, and forward crosslation 
(i = 0) is selected at step 902. The procedure shown in a block 904 is 
intended to derive the value xy. At step 906, i is incremented (to select 
backward crosslation), and at step 908 i is checked to see whether it has yet 
exceeded 1 . If not, the procedure 904 is repeated in order to derive the value 
xy for backward crosslation. 

The value i is again incremented at step 906, and, this time, step 908 
detects that i has exceeded 1, so the program proceeds to step 910. Here, the 
value j is incremented so as to select the next quantisation level. At step 912 
the program determines that the final quantisation value J has not yet been 
exceeded, and therefore the steps 902 to 910 are repeated. Thus, the values xy 
are calculated during procedure 904 for all values for j and for both forward 
and backward crosslation functions. 
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The procedure 904 involves initially setting a variable x H equal to the 
maximum possible value of x, T max at step 914. 

At step 916, the program determines the difference between the value 
of the crosslation function at this point xh, i-e. V(x H ), minus the mean value 
5 AV of the input signal x(t). The program then determines whether the 
modulus of this difference is greater than the predetermined threshold TH. 
Because the program starts by looking at the highest value of x, x max , the 
crosslation function will be approximately equal to the mean level AV, so the 
program would then proceed to step 918. At this point, the value of x H is 
10 decreased by an incremental quantity x* (representing the delay between 
successive stages of the delay line (DTL)). Step 916 is repeated. 

Thus, the program examines the crosslation functions, starting at the 
highest value x max , until step 916 detects that the crosslation functions steps 
outside the threshold TH. At this point, the program proceeds to step 920. 
15 At step 920, the program sets another variable x L , equal to the 

minimum possible value of x, x m j n . The program then proceeds to step 922. 
Here, the program determines whether the difference between the correlation 
function for the current value x L and the average value AV exceeds the 
threshold TH. If not, the program proceeds to step 924 where x L is increased 
20 by the incremental value Xj. The program then returns to step 922. This 
continues, with the program successively checking the crosslation function for 
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increasing values of t until the value falls outside the threshold region. The 

program then proceeds to step 926. 

At step 926, the program sets the value xy equal to the maximum of x H 

and x L and stores the value Xy for later use. 
5 At the end of the procedure shown in Figure 9, the program proceeds 

from step 912 to step 928, where the minimum sampling interval MIS is set 

equal to the maximum value of all the stored x*j values. 

This value is sent to the comparator (CMP) which compares the value 

with the value SPI representing the actual sampling interval. If the actual 
10 sampling interval is greater than MSI, then the comparator output (MSP) 

indicates that successive random numbers are expected to be statistically 

independent. If desired, the comparator output can be used to control the 

sampling interval, i.e. to increase it if the current sampling interval is determined 

to be smaller than MSI. 
15 While the forward crosslation (FC) function and the backward 

crosslation (BC) function provide a useful characterization of a process under 

investigation, in practical applications certain combinations, such as the sum or 

the difference, of the forward crosslation (FC) and backward crosslation (BC) 

functions may prove more informative. 
20 The sum Sl(t) of the forward crosslation (FC) function C + l (t) and the 

backward crosslation (BC) function C~l(t), 

S l (t) = C + L (x) + C" l (t) 
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is referred to as the crosslation sum (CS) function, and a typical example is 
shown in Fig. 10. The crosslation sum (CS) function Sl(t) provides information 
somewhat similar to that provided by the conventional autocorrelation function. 
In particular, the crosslation sum function of a Gaussian process is proportional 
5 to the autocorrelation function of that process. Furthermore, the crosslation sum 
(CS) function of any time-reversible process is an even function of its argument, 
the relative delay x . 

The difference Dl(t) of the forward crosslation (FC) function C + L (x) 
and the backward crosslation (BC) function C~l(x), 

10 Dl(t) « C\(t) - C- l (t) 

is referred to as the crosslation difference (CD) function. A typical example is 
also shown in Fig. 10. The crosslation difference (CD) function D L (x) provides 
information related to that provided by the derivative of the conventional 
autocorrelation function. In particular, the crosslation difference (CD) function 

15 of a Gaussian process is proportional to the negated derivative of the 
autocorrelation function of that process. Also, the crosslation difference (CD) 
function of any time-reversible process is an odd function of its argument, the 
relative delay x. 

The crosslation sum (CS) function and the crosslation difference (CD) 
20 function can be determined for a continuous-time signal x(t) with the use of a 
modified crosslator (CRS) shown in Fig. 1 1 . The system comprises a polarity- 
reversal circuit (PRC), an analogue delay line with multiple taps (TDL), a level 
crossing processor (LCP), two pulse delay circuits (PDL and DEL), a pulse 
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counter (PCT), a plurality of sample-and-hold circuits (SHC), a plurality of 
add/subtract accumulators (ASA) and a storage register (SRG). The storage 
register (SRG) may also incorporate a suitable waveform interpolator. 

The operations performed by the modified crosslator differ from those 
5 performed by the basic crosslator (CRS) in Fig. 7 as follows. 

The level crossing processor (LCP) produces a short trigger pulse (TP) 
each time a level crossing (upcrossing or downcrossing) is detected at the centre 
tap (CT) of the delay line (TDL). The desired crossing level L is set by applying 
a suitable threshold value to the threshold input (LV) of the level crossing 
10 processor (LCP). The required operation mode, to determine the crosslation sum 
function or the crosslation difference Sanction, is selected by applying a suitable 
value to a binary selector input (SD) of the level crossing processor (LCP). 

Each add/subtract accumulator (ASA) adds or subtracts sample values 
supplied by a respective sample-and-hold circuit (SHC), depending on the 
1 5 command, 'ADD' or 'SUBTRACT, appearing at its control input (AS). 

When the crosslation sum (CS) function is to be determined by the 
modified crosslator, the level crossing processor (LCP) sends command 'ADD', 
via the common control input (AS), to all the add/subtract accumulators (ASA), 
irrespective of the type of a detected level crossing (upcrossing or 
20 downcrossing). However, when the crosslation difference (CD) function is to be 
determined, the level crossing processor (LCP) sends command 'ADD 1 for each 
detected upcrossing, and command 'SUBTRACT for each detected 
downcrossing. Because in a continuous-time signal upcrossings and 
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downcrossings (of the same level) alternate, the operations ADD and 
SUBTRACT will also alternate following the crossings pattern. 

In the modified crosslator system, the pulse counter (PCT) counts all 
level crossings, but its capacity is always set to an even number 2N to ensure 
5 that the number of processed upcrossings is exactly the same as the number 
N" of processed downcrossings; hence, N* = N~ = N. 

The crosslator (CRS) of Fig. 1 1 could be used in the monitor (MON) of 
Fig. 7 by, for example, generating only a crosslation sum for each quantization 
level, and using the time-shift comparator (TSC) to calculate the maximum 
10 delay value |x|at which the crosslation sums exhibit a significant difference 
from the average value of input signal x(t). 

The analogue delay line (TDL) with multiple taps employed by the 
basic crosslator of Fig. 7 or the modified crosslator of Fig. 1 1 can be replaced by 
an analogue or digital serial-in-parallel-out (SBPO) shift register. Fig. 12 is a 
15 block diagram of the basic crosslator of Fig. 7 incorporating a SIPO shift register 
(SIPOSR). The system also comprises a signal conditioning unit (SCU), a clock 
generator (CKG), a level crossing detector (LCD), two pulse delay circuits (PDL 
and DEL), a pulse counter (PCT), a plurality of sample-and-hold circuits (SHC), 
a plurality of accumulators (ACC) and a storage register (SRG). The storage 
20 register (SRG) may also incorporate a suitable waveform interpolator. 

An analogue continuous-time signal x(t) is converted by a signal 
conditioning unit (SCU) into a suitable (analogue or digital) form and then 
applied to the serial input (EP) of the SIPOSR. 
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The SIPO shift register consists of M storage cells, CI, C2, ... , CM. 
Each cell has an input terminal, an output terminal and a clock terminal (CP). 
The cells are connected serially so that each cell, except for the first one (CI) 
and the last one (CM), has its input terminal connected to the output terminal of 
5 a preceding cell and its output terminal connected to the input terminal of a 
succeeding cell. The input terminal of cell CI is used as the serial input (IP) of 
the SIPO shift register. The output terminals of all M cells are regarded as the 
parallel output terminals of the SBPO shift register. All clock terminals (CP) of 
the cells are connected together to form the clock terminal of the SIPO shift 
1 0 register. 

A sequence of suitable clock pulses is provided by a clock generator 
(CKG). When at time instant to a clock pulse is applied to the clock terminal of 
the SIPO shift register, the signal sample stored in each cell is transferred 
(shifted) to and stored by the succeeding cell; cell CI stores the value x(to) of the 
15 input signal x(t). The shift register can be implemented either as a digital device 
or as a discrete-time analogue device, for example, in the form of a 
"bucket-brigade" charge-coupled device (CCD). 

The parallel outputs of the SIPO shift register are connected to respective 
M sample-and-hold circuits (SHC). Two selected adjacent SBPOSR outputs are 
20 also connected to two inputs of the level crossing detector (LCD). In the system 
shown in Fig. 12, the selected outputs are those of cell CY and cell CZ. 

If the number M of the SIPOSR outputs is odd, then preferably one of 
the two selected outputs is the middle output, i.e. output (M+l)/2, of the 
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SEPOSR. However, if the number of SIPOSR outputs is even, then the two 
selected outputs are preferably output M/2 and output M/2+1 . 

Because the SBPO shift register is operating in discrete time, defined by 
clock pulses provided by the clock generator (CKG), the detection of crossing a 
5 predetermined level L by signal samples is slightly more complicated. However, 
the crossing detection can be accomplished by applying the following decision 
rule: 

A. if output of CY < L and output of CZ > L, then a level 
upcrossing has occurred in a "virtual" cell VC positioned between cell CY and 

10 cell CZ; 

B. if output of CY > L and output of CZ < L, then a level 
downcrossing has occurred in cell VC positioned between cell CY and cell CZ; 

C. otherwise no level crossing has occurred in cell VC. 

From statistical considerations it follows that when the period of the 
15 clock generator is small compared to the variability in time of a signal being 
processed, the 'time* location of the virtual cell VC is uniformly distributed over 
the clock period. Consequently, the virtual cell VC is 'located' in the middle 
between cell CY and cell CZ. 

The crosslators (CRS) described above enable the generation of 
20 separate forward and crosslation functions (from which crosslation sum and 
crosslation difference functions can be derived), or the direct generation of 
crosslation sum and crosslation difference functions. Those functions can be 
generated for respective different crossing levels, which may be both positive 
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and negative. In a particular convenient arrangement, the input signal x(t) has 
an average value AV of zero which enables simplification of the processing of 
the crosslation functions. 

The choice of which crosslation function, or combination of functions, 
is to be used will dependent upon the application of the crosslator. It is 
envisaged that separate production of both forward and backward crosslation 
functions would be useful for determination of signal predictability. However 
other circumstances, such as signal classification, may warrant the use of 
crosslation sum and/or crosslation difference functions. In any event, the 
functions can be derived for a single crossing level or for multiple crossing 
levels. Generally speaking, for non-Gaussian signals, it is more informative 
to use one or more crossing levels which are significantly different from the 
mean AV of the signal x(t). 

It is also possible to derive other types of crosslation functions. In the 
arrangements described above, each function corresponds to a respective 
crossing level. It would be possible to derive additional functions which 
relate to a combination of (for example the difference between) crosslation 
functions relating to respective different crossing levels. For example, the 
crosslation function (i.e. either forward or backward crosslation function) 
based on a crossing level of the mean value AV could be subtracted from the 
corresponding crosslation function for a positive level L. For Gaussian 
signals, the resulting function is a scaled replica of the autocorrelation 
function. By comparing the resultant with a separately-derived 
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autocorrelation function it is possible to determine the extent to which the 
input signal characteristics depart from Gaussian characteristics. 
Furthermore, employing crosslation techniques for deriving an autocorrelation 
function for Gaussian signals is also regarded as independently useful. 

In the arrangements described above, only the sign of the slope of the 
input signal x(t) was considered, rather than its magnitude. However, this is 
not essential; instead, the crosslator could be arranged to distinguish between 
slopes of different magnitude in each of the positive and negative directions; 
that is, the slope could be represented by two or more bits, rather than a single 
bit (representative of either positive or negative slope). In this situation, 
separate crosslation functions could be derived for each quantised slope level. 
Alternatively, the arrangement may be such that only certain quantised slope 
levels (e.g. the steepest slopes) are taken into consideration in deriving a 
crosslation function. 

The input signal x(t) could represent any physical quantity of interest, 
such as noise, pressure, displacement, velocity, temperature, etc. 
Accordingly, the invention has wide fields of application, such as 
communications, radio astronomy, remote sensing, underwater acoustics, 
geophysics, speech analysis, biomedicine, etc. Although the specific 
examples given above refer to an input signal which varies with time, the 
argument of the function may represent any appropriate independent variable, 
such as relative time, distance, spatial location, angular position, etc. 
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If, as indicated above, the crosslator (CRS) is formed of a separate 
integrated circuit device, it is preferably provided with an input terminal for 
the input signal x(t), a threshold terminal for receiving a signal (LV) 
representing the crossing level and at least one output terminal for providing 
5 the output function (CSO) in either parallel or serial form. 

The foregoing description of preferred embodiments of the invention has 
been presented for the purpose of illustration and description. It is not intended 
to be exhaustive or to limit the invention to the precise form disclosed. In light 
of the foregoing description, it is evident that many alterations, modifications, 
10 and variations will enable those skilled in the art to utilize the invention in 
various embodiments suited to the particular use contemplated. 
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CLAIMS: 

1. Apparatus for analysing statistical characteristics of an input 
signal, the apparatus comprising: 

a signal input for receiving the signal; 
5 means coupled to the input for detecting events at which the signal 

level crosses a predetermined level with a predetermined slope; 

means for combining multiple versions of the signal, the versions 
being shifted with respect to each other by amounts corresponding to the 
spacing of said events, to form a representation of the signal; and 
10 means for measuring a parameter dependent upon the shape of said 

representation and indicative of a statistical characteristic of said signal. 

2. Apparatus as claimed in claim 1, arranged such that signals are 
deemed to have a predetermined slope if the slope has a predetermined sign. 

15 

3. Apparatus as claimed in claim 1 or claim 2, the apparatus 
being arranged to form a first representation in response to detected events of 
a first predetermined slope, and a second representation in response to 
detected events of a second different predetermined slope. 

20 

4. Apparatus as claimed in claim 3, wherein the parameter is 
dependent upon the shape of the combined first and second representations. 
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5. Apparatus as claimed in any preceding claim, wherein the 
event detecting means is operable to detect first and second different types of 
events, and the combining means is operable to combine versions of the signal 
shifted by amounts corresponding to the first type of events in a 

5 predetermined manner with versions of the signal shifted with respect to each 
other by amounts corresponding to the spacing of the second type of events to 
form said representation. 

6. Apparatus as claimed in claim 5, including mode switching 
10 means operable to change said predetermined manner of combination. 

7. Apparatus as claimed in any preceding claim, wherein said 
predetermined level is substantially different from the average level of the 
signal. 

15 

8. Apparatus as claimed in any preceding claim, including 
crossing level input means for receiving a signal defining said predetermined 
level. 

20 9. An integrated circuit including apparatus as claimed in any 

preceding claim, a first input terminal for receiving said input signal, a second 
input terminal for receiving a threshold signal representing said predetermined 
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level, and at least one output terminal for providing an output signal forming 
said representation. 

10. A method of analysing an input signal, the method comprising 
5 detecting events at which the signal level crosses a predetermined level with a 
predetermined slope, and forming a representation of a combination of 
multiple versions of the signal, the versions being shifted with respect to each 
other by amounts corresponding to the spacing of the events, the method 
further including the step of measuring a parameter dependent upon the shape 
1 0 of the representation . 



ABSTRACT 
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A signal can be analysed to determine statistical characteristics 
indicative of, for example, the predictability or time reversibility of the 
signal. The signal is examined to locate events corresponding to the crossing 
of predetermined levels with predetermined slopes. Multiple versions of the 
signal are combined, the versions being shifted with respect to each other by 
amounts corresponding to the spacings of the detected events. The shape of 
the resulting representation provides statistical information regarding the 
signal. 
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